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AMENDMENTS TO THE CLAIMS 
The Assignee submits below a complete listing of the current claims, including marked-up 
claims with insertions indicated by imderlining and deletions indicated by strikeouts and/or double 
bracketing. This listing of claims replaces all prior versions and listings of claims in the application: 

1 . (Currently amended) A method of evaluating grammars associated with a voice portal on a 
portal server, said method comprising: 

generating, for a current grammar of the voice portal representing a valid input for a first 
menu of the voice portal, a test input, the test input for the current grammar including a test pattern; 

providing the test input to the voice portal on the portal server using a voice server; 

receiving at least one measure of how distinguishable the current grammar is firom other 
grammars of a set of active grammars that are active when the current grammar is active, the set of 
active grammars including the current grammar and at least one grammar firom a second menu of 
the voice portal, the at least one measure based at least in part on analysis of the test pattern with 
respect to the set of active grammars, the at least one measure comprising at least one measure of 
how distinguishable the current grammar is fi-om the at least one grammar firom the second menu of 
the voice portal; and 

determinin g, based at least in part on the at least one measure, whether to modify the current 
grammar baaod at loast in part on the at least ono measur e fi-om the first menu to b e distinguishable 
from the at least one grammar firom the second menu . 

2. (Previously presented) The method of claim 1 , wherein the at least one measure of how 
distinguishable the current grammar is from other grammars of the set of active grammars includes 
a confidence level and a set of n-best results for the test input, and wherein the method fiurther 
comprises comparing the confidence level and set of n-best results for the test input with an 
expected value to assess the at least one measure of how distinguishable the current grammar is 
from other grammars of the set of active grammars. 
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3. (Previously presented) The method of claim 1, further comprising modifying the current 
grammar to create a modified grammar if the at least one measure indicates that the current 
grammar is not sufficiently distinguishable from the other grammars of the set of active grammars. 

4. (Previously presented) The method of claim 3, further comprising: 

(i) generating a test input for the modified grammar, the test input including a test pattern 
for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal on the portal 
server using the voice server; 

(iii) receiving at least one measure of how distinguishable the modified grammar is from 
other grammars of a set of active grammars that are active when the modified grammar is active, the 
modified grammar being one grammar of the set of active grammars that are active when the 
modified grammar is active; and 

(iv) modifying the modified grammar and repeating steps (i) through (iii) until the at least 
one measure of how distinguishable the modified grammar is from other grammars of the set of 
active grammars that are active when the modified grammar is active indicates that the modified 
grammar is sufficiently distinguishable from the other grammars of the set of active grammars that 
are active when the modified grammar is active. 

5 . (Previously presented) The method of claim 1 , fiirther comprising modifying the test pattern 
to emulate one or more user voices prior to providing the test input to the voice portal. 

6. (Previously presented) The method of claim 1 , further comprising modifying the test pattern 
to emulate the influence of one or more communications network qualities prior to providing the 
test input to the voice portal. 
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7. (Currently amended) A computer-readable storage medium encoded with instructions 
which, when executed by a computer, cause the computer to perform a method of evaluating 
grammars associated with a voice portal, the method comprising: 

generating, for a current grammar of the voice portal representmg a valid input for a first 
menu of the voice portal, a test input, the test input for the current grammar including a test pattern; 
providing the test input to the voice portal; 

receiving at least one measure of how distinguishable the current grammar is from other 
grammars of a set of active grammars that are active when the current grammar is active, the set of 
active grammars including the current grammar and at least one grammar from a second menu of 
the voice portal, the at least one measure based at least in part on analysis of the test pattern with 
respect to the set of active grammars, the at least one measure comprising at least one measure of 
how distinguishable the current grammar is from the at least one grammar from the second menu of 
the voice portal; and 

determinin g, based at least in part on the at least one measure, whether to modify the current 
grammar based at least in part on the at least on e m e asur e from the first menu to be distinguishable 
from the at least one grammar from the second menu . 

8. (Previously presented) The computer-readable storage medium of claim 7, wherein the at 
least one measure of how distinguishable the current grammar is from other grammars of the set of 
active grammars includes a confidence level and a set of n-best results for the test input, and 
wherein the method further comprises comparing the confidence level and set of n-best results for 
the test input with an expected value to assess the at least one measure of how distinguishable the 
current grammar is from other grammars of the set of active grammars. 

9. (Previously presented) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the current granmiar to create a modified grammar if the at 
least one measure indicates that the current grammar is not sufficiently distinguishable from the 
other grammars of the set of active grammars. 
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10. (Previously presented) The computer-readable storage medium of claim 9, wherein the 
method fiirther comprises: 

(i) generating a test input for the modified grammar, the test input including a test pattern 
for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal; 

(iii) receiving at least one measure of how distinguishable the modified grammar is from 
other grammars of a set of active grammars that are active when the modified grammar is active, the 
modified grammar being one grammar of the set of active grammars that are active when the 
modified grammar is active; and 

(iv) modifying the modified grammar and repeating steps (i) through (iii) until the at least 
one measure of how distinguishable tiie modified grammar is from other granmiars of the set of 
active grammars that are active when the modified granmiar is active indicates that the modified 
grammar is sufficiently distinguishable from the other grammars of the set of active grammars that 
are active when the modified grammar is active. 

1 1 . (Previously presented) The computer-readable storage medium of claim 7, wherein the 
method fiirther comprises modifying the test pattern to emulate one or more user voices prior to 
providing the test input to the voice portal. 

12. (Previously presented) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the test pattern to emulate the influence of one or more 
communications network qualities prior to providing the test input to the voice portal. 

1 3 . (Currently amended) A system for evaluating grammars of a voice portal executing on a 
portal server, the system comprising: 

an analysis interface for extracting to extract a current grammar from a set of active 
grammars of the voice portal, the current grammar representing a valid input for a first menu of the 
voice portal and being one grammar of the set of active grammars, the set of active grammars 
including at least one grammar from a second menu of the voice portal; 
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a test pattern generator for gen e rating to generate a test input for the current grammar, the 
test input including a test pattern; 

a text-to-speech engine on a computer for entering to enter the test input into the voice 

portal; 

a results collector for analyzing to analyze the test input entered into the voice portal agamst 
the set of active grammars; and 

a results analyzer for d e riving to derive a set of statistics indicative of how distinguishable 
the current grammar is from other grammars of the set of active grammars, the set of statistics being 
indicative of how distinguishable the current grammar is from the at least one grammar from the 
second menu of the voice porta l, and to determine, based at least in part on the at least one measure. 
whether to modify the current grammar from the first menu to b e distinguishable from the at least 
one grammar from the second menu . 

14. (Previously presented) The system of claim 13, wherein the set of statistics includes a 
confidence level and a set of n-best results for the test input, and wherein the results analyzer is 
configured to compare the confidence level and set of n-best results for the test input with an 
expected value to assess how distinguishable the current grammar is from other grammars of the set 
of active grammars. 

1 5 . (Previously presented) The system of claim 1 3, wherein the test pattern generator is 
configured to modify the test pattern to emulate one or more user voices prior to entering the test 
input into the voice portal. 

1 6. (Previously presented) The system of claim 13, wherein the test pattern generator is 
configured to modify the test pattern to emulate the influence of one or more communications 
network qualities prior to entering the test input into the voice portal. 

17. (Cancelled) 
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18. (New) The system of claim 1 3, further comprising at least one processor programmed to act 
as the analysis interface, the test pattern generator, the text-to-speech engine, and the results 
analyzer. 



2202115-1 



